The information-theoretical viewpoint on the physical complexity of classical and 
quantum objects and their dynamical evolution 
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Charles Bennett's measure of physical complexity for classical objects, namely logical-depth, is 
used in order to prove that a chaotic classical dynamical system is not physically complex. 

The natural measure of physical complexity for quantum objects, quantum logical-depth, is then 
introduced in order to prove that a chaotic quantum dynamical system is not physically complex 
too. 
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I. INTRODUCTION: THE SHALLOWNESS OF RANDOM OBJECTS 

Despite denoting it with the term "complexity", Andrei Nikolaevich Kolmogorov 0, 0, 0, 0, @ introduced the 
notion denoted nowadays by the school of Paul Vitanyi .6] as "plain-Kolmogorov-complexity" (that I will denote with 
the letter K from here and beyond) in order of obtaining an intrinsic measure of the amount of information of that 
object and not as a measure of the amount of physical-complexity of that object. 

That the amount of information and the amount of physical complexity of an object are two completely different 
concepts became further clear after the introduction by Gregory Joseph Chaitin of the notion denoted nowadays by 
the school of Paul Vitanyi |(| as "prefix-Kolmogorov-complexity" and denoted by the school of Chaitin and Cristian 
S. Calude simply as algorithmic information [jj (and that I will denote with the letter I from here and beyond) and 
the induced notion of algorithmic-randomness: 

an algorithmically random object has a very high algorithmic information but is certainly not physically-complex. 

Such a simple consideration is indeed sufficient to infer that algorithmic information can be seen in no way as a 
measure of physical complexity. 

A natural measure of physical complexity within the framework of Algorithmic Information Theory, the logical 
depth, was later introduced by Gregory Chaitin and Charles Bennett ||, constituting what is nowadays generally 
considered as the algorithmic information theoretic viewpoint as to physical complexity, though some author can 
still be found who not only ignores that, as it was clearly realized by Brudno himself [fj, fioj ]. [TT| . the chaoticity 
of a dynamical system (defined as the strict positivity of its Kolmogorov-Sinai entropy) is equivalent to its weak 
algorithmic chaoticity (defined as the condition that almost all the trajectories, symbolically codified, are Brudno- 
algorithmically random) but is weaker than its strong algorithmic chaoticity (defined as the condition that almost all 
the trajectories, symbolically codified, are Martin-Ldf-Solovay-Chaitin-algorithmically random), but uses the notions 
of chaoticity and complexity as if they were synonymous, a thing obviously false since, as we have seen, the (weak) 
algorithmic randomness of almost all the trajectories of a chaotic dynamical system implies exactly the opposite, 
namely that its trajectories are not complex at all. 

Indeed it is natural to define complex a dynamical system such that almost all its trajectories, symbolically codified, 
are logical deep. 

So, despite the the still common fashion to adopt the terms " chaoticity" and " complexity" as synomymous, one has 
that that every chaotical dynamical system is shallow, as I will show in sectiorlTTl and sectior llTfl 

The key point of such an issue is so important to deserve a further repetition with the own words of Charles Bennett 
illustrating the physical meaning of the notion of logical depth and the reason why it is a good measure of physical 
complexity: 

"The notion of logical- depth developed in the present paper was first described in llaL and at greater length in \1 3] 
and flAl : similar notions have been independently introduced by ("votential" ). T7a/ ("incomplete sequence"). 
("hitting time") and Koppel, this volume ("sophistication"). See also Wolfram's work on "computational 
irreducibility" XlSil and Hartmanis' work on time- and space-bounded algorithmic information 

" We propose depth as a formal measure of value. From the earliest days of information theory it has been 
appreciated that information per se is not a good measure of message value. For example a typical sequence of coin 
tosses has high information content but little value; an ephemeresis, giving the positions of the moon and planets 
every day for a hundred years, has no more information than the equations of motions and initial conditions from 
which it was calculated, but saves its owner the effort of recalculating these positions. The value of a message thus 
appears to reside not in its information (its absolutely unpredictable parts), nor in its obvious redudancy (verbatim 
repetitions, unequal digit frequencies) , but rather in what might be called its buried redudancy - parts predictable only 
with difficulty, things the receiver could in principle have figured out without being told, but only at considerable cost 
in money, time or computation. In other words the value of a message is the amount of mathematical or other work 
plausibly done by its originator, which its receiver is saved from having to repeat" 

The quantum analogue of such a notion, i.e. quantum logical depth, is introduced in sectior llVl 
The definition of the physical complexity of a quantum dynamical system is then introduced in sectiorlVl where it 
is shown that in the quantum case, as in the classical case, a physically complex dynamical system is not chaotic. 
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II. THE DEFINITION OF THE PHYSICAL COMPLEXITY OF STRINGS AND SEQUENCES OF 

CBITS 



I will follow from here and beyond the notation of my Phd-thesis ; consequentially, given the binary alphabet 
S := {0 , 1}, I will denote by E* the set of all the strings on E (i.e. the set of all the strings of cbits), by E°° the set 
of all the sequences on E (i.e. the set of all the sequences of cbits) and by CHAITIN — RAN DOM (X°°) its subset 
consisting of all the Martin-L6f-Solovay-Chaitin random sequences of cbits. 

I will furthermore denote strings by an upper arrow and sequences by an upper bar, so that I will talk about the 
string x G E* and the sequence x G E°°; \x\ will denote the length of the string x, x n will denote the n'^-digit of the 
string x or of the sequence x, while x n will denote its prefix of length n. 

I will, finally, denote by <; the lexicographical-ordering relation over E* and by string(n) the n th string in such an 
ordering. 

Fixed once and for all a universal Chaitin computer U, let us recall the following basic notions: 
given a string x G E* and a natural number n G N: 

Definition II. 1 

canonical program of x: 

x* := min-rj/GE* : U(y) = (2.1) 



Definition II.2 

x is n- compressible: 

\x*\ < \x\ - n (2.2) 



Definition II. 3 

x is n-incompressible: 

\x*\ > \x\ - n (2.3) 



Definition II. 4 

halting time of the computation with input x: 

rpi^\ \ number of computational steps after which U halts on input x , if U(x) =1 , . 

^ ' | +oo, otherwise. ^ ' ' 

We have at last all the ingredients required to introduce the notion of logical depth as to strings. 
Given a string x G E* and two natural number s, t G N: 

Definition II. 5 

logical depth of x at significance level s: 

D s (x) := mm{T(y) : U(y) — x , y s-incompressible } (2-5) 



Definition II. 6 

x is t-deep at significance level s: 



D s {x) > t 



(2.6) 
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Definition II.7 

x is t- shallow at significance level s: 

D s (x) < t (2.7) 

I will denote the set of all the t-deep strings as t — DEEP(T,*) and the set of all the t-shallow strings as t — 
SHALLOW^*) . 

Exactly as it is impossible to give a sharp distinction among Chaitin-random and regular strings while it is possible 
to give a sharp distinction among Martin-Ldf-Solovay-Chaitin-random and regular sequences, it is impossible to give 
a sharp distinction among deep and shallow strings while it is possible to give a sharp distinction among deep and 
shallow sequences. 

Given a sequence x G 

Definition II. 8 

x is strongly deep: 

card{n G N : D s (x(n)) > f(n)} < tt Vs G N, V/ G REC - MAP(N , N) (2.8) 

where, following once more the notation adopted in yj], REC — MAP(N , N) denotes the set of all the (total) recursive 
functions over N. 

To introduce a weaker notion of depth it is necessary to fix the notation as to reducibilities and degrees: 
denoted the Turing reducibility by <t and the polynomial time Turing reducibility by <^ [2Cl | let us recall that there 
is an intermediate constrained-reducibility among them: the one, called recursive time bound reducibility, in which the 
halting-time is constrained to be not necessarily a polynomial but a generic recursive function; since recursive time 
bound reducibility may be proved to be equivalent to truth-table reducibility (I demand to |2l|.[7| for its definition and 
for the proof of the equivalence) I will denote it by <tt- 

A celebrated theorem proved by Peter Gacs in 1986 states that every sequence is computable by a Martin 
Lof-Solovay-Chaitin-random sequence: 

Theorem II. 1 

Gacs' Theorem: 

x < T y Vz G S°° , Vy G CHAITIN - RANDOM (£°°) (2.9) 
This is no more true, anyway, if one adds the constraint of recursive time bound, leading to the following: 
Definition II. 9 

x is weakly deep: 

3y e CHAITIN - RANDOM(Y,°°) : -.(x <« y) (2.10) 

I will denote the set of all the strongly-deep binary sequences by STRONGLY — DEEP(E°°) and the set of all the 
weakly-deep binary sequences as WEAKLY — DEEP(T,°°). 
Shallowness is then once more defined as the opposite of depth: 

Definition 11.10 

strongly- shallow sequences of cbits: 

STRONGLY - SHALLOW^ 00 ) := £°° - (STRONGLY - DEEP^ 00 )) (2.11) 



Definition 11.11 

weakly-shallow sequences of cbits: 

WEAKLY - SHALLOW^ 00 ) := E°° - (WEAKLY - DEEP(E°°)) (2.12) 
Weakly-shallow sequences of cbits may also be characterized in the following useful way : 



Theorem II. 2 

Alternative characterization of weakly-shallow sequences of chits: 

x £ WEAKLY - SHALLOW^ 00 ) <S> ^recursive : x £ fx — RANDOM (S°°) (2.13) 

where, following once more the notation of [i — RAN DOM (JI 00 ) denotes the set of all the Martin-L6f random 
sequences w.r.t. the measure fi. 

As to sequences of cbits, the considerations made in sectiorjflmay be thoroughly formalized through the following: 

Theorem II. 3 

Weak- shallowness of Martin Lof - Solovay - Chaitin random sequences: 

CHAITIN - RANDOM (£°°) n WEAKLY - DEEP[T,°°) = (2.14) 

PROOF: 

Since the Lebesgue measure ^Lebesgue is recursive and by definition: 

CHAITIN - RANDOM{Y,°°) = fi L ebesgue - RANDOM^ 00 ) (2.15) 
the thesis immediately follows by theorerr TlI.21 ■ 
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III. THE DEFINITION OF THE PHYSICAL COMPLEXITY OF CLASSICAL DYNAMICAL SYSTEMS 

Since much of the fashion about complexity is based on a spread confusion among different notions, starting from 
the basic difference among plain Kolmogorov complexity K and algorithmic information I, much care has to be taken. 
Let us start from the following notions by Brudno: 

Definition III.l 

Brudno algorithmic entropy of x G 

B (x) := lim ffi^l (3.1) 

71^00 n 

At this point one could think that considering the asympotic rate of algorithmic information instead of plain 
Kolmogorov complexity would result in a different definition of the algorithmic entropy of a sequence. 
That this is not the case is the content of the following: 

Theorem III.l 



B(x) = lim ^0) (3 . 2) 

n— >oo n 

PROOF: 

It immediately follows by the fact that |23| : 

\I(x(n)) - K(x(n))\ < o{n) (3.3) 

■ 

Definition III.2 

x G E°° is Brudno-random: 

B{x) > (3.4) 

I will denote the set of all the Brudno random binary sequences by BRUDNO(T,°°). 

One great source of confusion in a part of the literature arises from the ignorance of the following basic result proved 
by Brudno himself [t|: 

Theorem III. 2 

Brudno randomness is weaker than Chaitin randomness: 

BRUDNO - RANDOM(E°°) D CHAITIN - RANDOM (E°°) (3.5) 

as we will see in the sequel of this section. 

Following the analysis performed in (to which I demand for further details) I will recall here some basic notion 
of Classical Ergodic Theory: 

given a classical probability space (A" , /i) : 

Definition III. 3 

endomorphism of (X , /i): 
T : HALTING^) -> HALTING^) surjective : 

H{A) = niT^A) Vie HALTING(n) (3.6) 

where HALTING(ii) is the halting-set of the measure /1, namely the cr-algebra of subsets of X on which /1 is defined. 

Definition III. 4 
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classical dynamical system: 
a triple (X , fi,T) such that: 



• (X , pi) is a classical probability space 

• T : HALTING(fi) -> HALTING{p) is an endomorphism of (X , /i) 



Given a classical dynamical system (X , /j , T): 
Definition III. 5 



(X , fx, T) is ergodic: 



^ 71— 1 

lim^oo- V /iM nT k (B)) = n(A) u(B) V A,B e HALTINGU) (3.7) 



fc=o 

Definition III.6 

n-letters alphabet: 

Clearly: 

E 2 = E 

Given a classical probability space (X , /i) : 
Definition III. 7 

finite measurable partition of (X , /i) : 

A = {A , ■■■ i„_i}n6N : 

At e HALTING(fi) i = , • • • , n - 1 

Ai n Aj = Vi ^ j 

K x - u£b%) = o 

1 will denote the set of all the finite measurable partitions of (X , /x) by 7 , ( X , /i ] 
Given two partitions A = {AJ™^ 1 , B = {Bj}™^ 1 £ V{X, fi): 

Definition III.8 

A is a coarse-graining of B [A < B): 

every atom of A is the union of atoms by B 

Definition III.9 

coarsest refinement of A = {Ai}™~Q and B = {Bj}" 1 ^ 1 £?(!,/(): 



En := {0,-- - (3.8) 
E 2 = E (3.9) 



(3.10) 



A V B e V{X,n) 

Ay B := { A4 n Bj i = 0, • • • , n - 1 j = 0, ■ • • , m - 1} 



(3.11) 



Clearly V(X, fi) is closed both under coarsest refinements and under endomorphisms of (X, fi). 
Let us observe that, beside its abstract, mathematical formalization, the definitior llll.7l has a precise operational 
meaning. 

Given the classical probability space {X, fi) let us suppose to make an experiment on the probabilistic universe 
it describes using an instrument whose distinguishing power is limited in that it is not able to distinguish events 
belonging to the same atom of a partition A = {A;}™^ 1 G V(X, fi). 

Consequentially the outcome of such an experiment will be a number: 

r 6 E„ (3.12) 
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whose classical probabilistic 



specifying the observed atom A r in our coarse-grained observation of (X, /x) . 

I will call such an experiment an operational observation of (X,fi) through the partition A. 

Considered another partition B = {Bj}™^ 1 £ V(X, /i) we have obviously that the operational observation of (X, /i) 
through the partition A V B is the conjuction of the two experiments consisting in the operational observations of 
(X, n) through the partitions, respectively, A and B. 

Consequentially we may consistently call an operational observation of (X, fi) through the partition A more simply 
an A-experiment. 

The experimental outcome of an operational observation of {X,[i) through the partition A — {Ai}™~Q £ V(X,/i) 
is a classical random variable having as distribution the stochastic vector 

Vm(A„ 1), 

information, i.e. its Shannon entropy, I will call the entropy of the partition A, according to the following: 
Definition III. 10 

entropy of A= {A^Zo G V(X,n): 

j KAo) \ 

H(A):=H(\ : ) (3.13) 

V(An-l) ) 

It is fundamental, at this point, to observe that, given an experiment, one has to distinguish between two conceptually 
different concepts: 

1. the uncertainty of the experiment, i.e. the amount of uncertainty on the outcome of the experiment before to 
realize it 

2. the information of the experiment, i.e. the amount of information gained by the outcome of the experiment 

As lucidly observed by Patrick Billingsley 24] , the fact that in Classical Probabilistic Information Theory both these 
concepts are quantified by the Shannon entropy of the experiment is a consequence of the following: 

Theorem III. 3 

The soul of Classical Information Theory: 

information gained = uncertainty removed (3-14) 

Theorer rlIII.3l applies, in particular, as to the partition-experiments we are discussing. 
Let us now consider a classical dynamical system CDS := (X , \i , T). 

The T-invariance of /i implies that the partitions A = {Ai}"~^ and T~ 1 A := {T~ x Ai}™~Q have equal probabilistic 
structure. Consequentially the A-experiment and the T^ 1 A-experiment are replicas, not necessarily independent, of 
the same experiment, made at successive times. 

In the same way the V£~q T~ k A-experiment is the compound experiment consisting of n repetitions 
A , T~ 1 A , , ■ • • , T^^^^A of the experiment corresponding to A G V(X, [i). 

The amount of classical information per replication we obtain in this compound experiment is clearly: 

\n{Vlr = lT~ k A) 

It may be proved |25| that when n grows this amount of classical information acquired per replication converges, so 
that the following quantity: 

h(A, T) := Um n ^ 00 l-H{\flZnT- k A) (3.15) 

exists. 

In different words, we can say that h(A, T) gives the asymptotic rate of acquired classical information per replication 
of the A-experiment. 

We can at last introduce the following fundamental notion originally proposed by Kolmogorov for K-systems and 
later extended by Yakov Sinai to arbitrary classical dynamical systems [2^ , , |27| . [28| , [25| : 
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Definition III.ll 

Kolmogorov-Sinai entropy of CDS: 

h C Ds ■■= sup AeP ( X ,n)h(A,T) (3.16) 

By definition wc have clearly that: 

h C DS > (3.17) 

Definition 111.12 

CDS is chaotic: 

h CDS > (3.18) 

Dcfinitio rllll. 121 shows explicitly that the concept of classical-chaos is an information-theoretic one: 

a classical dynamical system is chaotic if there is at least one experiment on the system that, no matter how many 
times we insist on repeating it, continues to give us classical information. 

That such a meaning of classical chaoticity is equivalent to the more popular one as the sensible (i.e. exponen- 
tial) dependence of dynamics from the initial conditions is a consequence of Pesin's Theorem stating (under mild 
assumptions) the equality of the Kolmogorov-Sinai entropy and the sum of the positive Lyapunov exponents. 

This inter-relation may be caught observing that: 

• if the system is chaotic we know that there is an experiment whose repetition definitely continues to give 
information: such an information may be seen as the information on the initial condition that is necessary to 
furnish more and more with time if one want to keep the error on the prediction of the phase-point below a 
certain bound 

• if the system is not chaotic the repetition of every experiment is useful only a finite number of times, after which 
every further repetition doesn't furnish further information 

Let us now consider the issue of symbolically translating the coarse-grained dynamics following the traditional way 
of proceeding described in the second section of |2^| : given a number n S N : n > 2 let us introduce the following: 

Definition III. 13 

n-adic value: 

the map v n : E£° i-> [0, 1]: 

oo 

v n (x) :=Y.~, ( 3 - 19 ) 

i=l 



the more usual notation: 

and the following: 
Definition III. 14 



(0.,-, •••.,•„. •••;„ := v n (x) xgX^ (3.20) 



n-adic nonterminating natural positional representation: 
the map r n : [0,1] i-» 



r„((0.xi ■■■x i ■■■)„) := x (3.21) 



with the nonterminating condition requiring that the numbers of the form (O.Xx ■ ■ ■ Xi(n — 1))„ = (0. • • • (xi + l)0) n 
are mapped into the sequence x% ■ ■ ■ Xi(n — 1). 
Given ni,ri2 € N : mm(ri.i, 712) > 2: 



Definition 111.15 
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change of basis from n\ to n 2 : 
the map c6 ni! „ 2 : £~ i-> £ r f 2 : 

cb nun2 (x) := r n2 (v ni (x)) (3.22) 

It is important to remark that Q : 
Theorem III. 4 

Basis-independence of randomness: 

RANDOM (E™) = cb nurl2 (RAN DOM (E™)) Vm,n 2 € N : min(ni,n 2 ) > 2 (3.23) 

Considered a partition v4 = {AJ™^ 1 G V(X,/j,): 

Definition III. 16 

symbolic translator of CDS w.r.t. A: 
i>A '■ x 

0a(x) := i : I £ A ( (3.24) 

In this way one associates to each point of X the letter, in the alphabet having as many letters as the number of 
atoms of the considered partition, labeling the atom to which the point belongs. 

Concatenating the letters corresponding to the phase-point at different times one can then codify k £ N steps of 
the dynamics: 

Definition 111.17 



k-point symbolic translator of CDS w.r.t. A: 

iifix) ■■= -]zlMT j x) (3.25) 



: X -> E k n : 



and whole orbits: 
Definition III. 18 

orbit symbolic translator of CDS w.r.t. A: 

^(x) := f^ A (T j x) (3.26) 

The asymptotic rate of acquisition of plain Kolmogorov complexity of the binary sequence obtained translating 
symbolically the orbit generated by x £ X through the partition A 6 V(X , fi) is clearly given by: 

Definition III. 19 



B(A,x) := B(cb card{A] ^(x))) (3.27) 

We saw in dcfinitior llll.lll that the Kolmogorov-Sinai entropy was defined as K(A, x) computed on the more 
probabilistically-informative A-experiment; in the same way the Brudno algorithmic entropy of x is defined as the 
value of B(A, x) computed on the more algorithmically-informative A-experimcnt: 

Definition 111.20 

Brudno algorithmic entropy of (the orbit starting from) x: 

Bcds{x) := suPAe-p(x, A1 )^(c6 C ard(A),2(V'i 00) (a;))) (3-28) 

Demanding to 0] for further details, let us recall that, as it is natural for different approaches of studying a same 
object, the probabilistic approach and the algorithmic approach to Classical Information Theory are deeply linked: 
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the partial map Dj : E* i— > S* defined by: 

£>/(£) := (3.29) 

is by construction a prefix-code of pure algorithmic nature, so that it would be very reasonable to think that it may 
be optimal only for some ad hoc probability distribution, i.e. that for a generic probability distribution P the average 
code word length of Di w.r.t. P: 

L Dl<P = J2 P{x)I{S) (3.30) 

xeHALTING(D!) 

won't achieve the optimal bound, the Shannon information H(P), stated by the corner stone of Classical Probabilistic 
Information, i.e. the following celebrated: 

Theorem III. 5 

Classical noiseless coding theorem: 

H(P) < L P < H(P) + 1 (3.31) 

(where Lp is the minimal average code word length allowed by the distribution P) 

Contrary, the deep link between the probabilistic- approach and the algorithmic- approach makes the miracle: under 
mild assumptions about the distribution P the code Dj is optimal as it is stated by the following: 

Theorem III.6 

Link between Classical Probabilistic Information and Classical Algorithmic Information: 
HP: 



P recursive classical probability distribution over X* 

TH: 



3c P e R + : < L Dl>P -H(P) < c P (3.32) 

With an eye at theoren llll.ll it is then natural to expect that such a link between classical probabilistic information and 
classical algorithmic information generates a link between the asymptotic rate of acquisition of classical probabilistic 
information and the asymptotic rate of acquisition of classical algorithmic information of the coarse grained dynamics 
of CDS observed by repetitions of the experiments for which each of them is maximal. 

Demanding to [l(J for further details such a reasoning, properly formalized, proves the following: 

Theorem III. 7 

Brudno's theorem: 
HP: 

CDS ergodic 

TH: 

hcDS = B C ds(x) V - n — a.e.x G X (3.33) 

Let us now consider the algorithmic approach to Classical Chaos Theory strongly supported by Joseph 
Ford, whose objective is the characterization of the concept of chaoticity of a classical dynamical system as the 
algorithmic-randomness of its symbolically-translated trajectories. 

To require such a condition for all the trajectories would be too restrictive since it is reasonable to allow a chaotic 
dynamical system to have a countable number of periodic orbits. 

Let us then introduce the following two notions: 



13 



Definition 111.21 



CDS is strongly algorithmically- chaotic: 



V - (i - a.e. xeX,3Ae V(X, fj) : cb ca rd(A)MA [x)) € CHAITIN - RANDOM^ 00 ) 



(3.34) 



Definition 111.22 



CDS is weak algorithmically- chaotic: 



V-n-a.e.xeX, 3AeV{X,n) : cb^^^P [x)) g BRUDNO — RANDOM(Y,°°) 



(3.35) 



The difference between definitior llll.21l and definitior llll. 221 follows by Theorei rlIII.21 
Clearly Theorerr llll. 71 implies the following: 



Corollary III.l 



chaoticity — weak algorithmic chaoticity 
chaoticity < strong algorithmic chaoticity 



that shows that the algorithmic approach to Classical Chaos Theory is equivalent to the usual one only in weak sense. 

The plethora of wrong statements found in a part of the literature caused by the ignorance of corollary IIII.ll is 
anyway of little importance if compared with the complete misunderstanding of the difference existing among the 
concepts of chaoticity and complexity for classical dynamical systems; with this regards the analysis made in sectior[l] 
may be now thoroughly formalized introducing the following natural notions: 

Definition 111.23 

CDS is strongly- complex: 



Definition 111.24 

CDS is weakly complex: 

V - fj, - a.e.x eX,3Ae V(X, fi) : cb card{A) . 2 {ip ( ™ ] (x)) g WEAKLY - COMPLEX^ 00 ) (3.37) 
One has that: 
Theorem III.8 

Weak- shallowness of chaotic dynamical systems: 



V - n - a.e.x eX ,3Ae V(X, (i) : cb card(A)a (^> (xj) g STRONGLY - COMPLEX^ 00 ) 



(3.36) 



CDS chaotic =>■ CDS weakly-shallow 



PROOF: 



The thesis immediately follows combining thcorcrr TlI.SI with the definitions def lIII.23l and dcf lIII.24l B 
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IV. THE DEFINITION OF THE PHYSICAL COMPLEXITY OF STRINGS AND SEQUENCES OF 

QUBITS 



The idea that the physical complexity of a quantum object has to be measured in terms of a quantum analogue of 
Bennett's notion of logical depth has been first proposed by Michael Nielsen |3(ij] . |3l| . 

Unfortunately, beside giving some general remark about the properties he thinks such a notion should have, Nielsen 
have not given a mathematical definition of it. 

The first step in this direction consists, in my opinion, in considering that, such as the notion of classical-logical- 
depth belongs to the framework of Classical Algorithmic Information Theory, the notion of quantum-logical-depth 
belongs to the framework of Quantum Algorithmic Information Theory |ll|. 

One of the most debated issues in such a disci plin e, first discussed by its father Karl Svozil j^] and rediscovered 
later by the following literature |3^|, j3^|, [3{|, |36|. |37|. [Tl| . is whether the programs of the involved universal 
quantum computers have to be strings of cbits or strings of qubits. 

As I have already noted in [Tlj . anyway, it must be observed that, owing to the natural bijection among the 
computational basis £* of the Hilbert space of qubits' strings (notions that I am going to introduce) and £*, one can 
always assume that the input is a string of qubits while the issue, more precisely restated, is whether the input has 
(or not) to be constrained to belong to the computational basis. 

So, denoted by H2 ■= C 2 the one-qubit's Hilbert space (endowed with its orthonormal computational basis 
£2 '■= {\i >,i € £}) , denoted by TL® " := 0^ =o the n-qubits' Hilbert space, (endowed with its orthonormal 
computational basis £ n := {\x >,x £ E"}), denoted by Tt® * := @^L 7i® " the Hilbert space of qubits' strings 
(endowed with its orthonormal computational basis := {\x >,x G £*}) and denoted by °° := ®neN^ 2 the 
Hilbert space of qubits' sequences (endowed with its orthonormal computational rigged-basis 1 £oo := {\x >, x 6 E°°}), 
one simply assumes that, instead of being a classical Chaitin universal computer, U is a quantum Chaitin universal 
computer, i.e. a universal quantum computer whose input, following Svozil's original position on the mentioned issue, 
is constrained to belong to and is such that, w.r.t. the natural bijection among and S*, satisfies the usual 
Chaitin constraint of having prefix-free halting-set. 

The definition of the logical depth of a string of qubits is then straightforward: 

given a vector \ip >G TCf and a string 

Definition IV. 1 

canonical program of \ip >: 

\<ip >* := mm{y G S* : U(y) = >} (4.1) 



Definition IV.2 

halting time of the computation with input \x >: 

, _» J number of computational steps after which U halts on input x , if U(x) =1 , . 

^ ' 1 +00, otherwise. ^ ' ' 

Definition IV.3 

logical depth of \ip > at significance level s: 

D s (\tp >) := min{T(y) : U{y) = \ip >, y s- incompressible } (4.3) 



Definition IV.4 



as it should be obvious, the unusual locution rigged-basis I am used to adopt is simply a shortcut to denote that such a "basis" has to 
be intended in the mathematical sense it assumes when 00 is considered as endowed with a suitable rigging, i.e. as part of a suitable 
rigged Hilbert space S C ti® °° C S' as described in l38l . l3li 
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\ip > is t-deep at significance level s: 



D s {\ip>) > t (4.4) 



Definition IV. 5 

\ip > is t- shallow at significance level s: 



D s (\i> >) < t (4.5) 



I will denote the set of all the t-deep strings of qubits as t — DEEP{H^ ). 

Let us observe that a sharp distinction among depth and shallowness of qubits' strings is impossible; this is nothing 
but a further confirmation of the fact, so many times shown and analyzed in ^l]]> that almost all the concepts of 
Algorithmic Information Theory, both Classical and Quantum, have a clear, conceptually sharp meaning only when 
sequences are taken into account. 

The great complication concerning sequences of qubits consists in that their mathematically-rigorous analysis re- 
quires to give up the simple language of Hilbert spaces passing to the more sophisticated language of noncommutative 
spaces] indeed, as extensively analyzed in |Tlj adopting the notion of noncommutative cardinality therein explicitly 
introduced 2 , the fact that the correct noncommutative space of qubits' sequences is the hyperfinite ll\ factor: 

Definition IV.6 

noncommutative space of qubits' sequences: 

oo 

^nc ■= ®(-Ma(<C), Tunbiased) = R (4.6) 
n=0 

and not the noncommutative space B{H.2® °°) of all the bounded linear operators on H.2® °° (that could be still 
managed in the usual language of Hilbert spaces) is proved by the fact that, as it must be, has the continuum 

noncommutative- cardinality : 

card N c(Z% c ) = Ni (4.7) 
while B{TL2® °°) has only the countable noncommutative cardinality: 

cardjfcf&ttc) = H o (4.8) 

While the definitior lll.81 of a strongly-deep sequence of cbits has no natural quantum analogue, the definition of a 
weakly-deep sequence of qubits is straightforward. 

Denoted by RANDOM(Y,^ c ) the space of all the algorithmically random sequences of qubits, for whose charac- 
terization I demand to |ll| . let us observe that the equality between truth-table reducibility and recursive time bound 
reducibility existing as to Classical Computation may be naturally imposed to Quantum Computation in the following 
way: 

given two arbitrary mathematical quantities x and y: 
Definition IV.7 

x is quantum-truth-table reducible to y: 

x <f t y := x is U-computable from y in bounded U-computable time (4-9) 
Given a sequence of qubits a £ S^ c : 
Definition IV.8 



2 following Miklos Redei's many remarks I4I.I . |41| mentioned in llll . about how Von Neumann considered his classification of factors as 
a theory of noncommutative cardinalities though he never thought, as well as Redei, that the same N's symbolysm of the commutative 
case could be adopted 
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a is weakly-deep: 

3b G RAN DOM{Yf^ c ) : -i (6 <f t b) (4.10) 
Denoted the set of all the weakly-deep sequences of qubits as WEAKLY — DEEP(Y>°^ C ): 
Definition IV.9 

set of all the weakly- shallow sequences of qubits: 

WEAKLY - SH ALLOW (T^ c ) := - (WEAKLY - DEEP{T,^ C )) (4.11) 

It is natural, at this point, to conjecture that an analogue of theorerr lll. 21 exists in Quantum Algorithmic Information 
Theory too: 

Conjecture IV. 1 

Alternative characterization of weakly- shallow sequences of qubits: 

a G WEAKLY - SH ALLOW (Vfi c ) & 3lu G S(Z% c ) U - computable : a G to - RANDOM (Ejyc) ( 4 - 12 ) 

where cj — RANDOM(Yj^ c ) denotes the set of all the u>- random sequences of qubits w.r.t. the state u> <E S'(E^ C ) to 
be defined generalizing the definition of RANDOM(T,^ c ) to states different by T un i,i ase d along the lines indicated in 
|ll| as to the definition of the laws of randomness £randomness(^-''nc > w ) 01 the noncommutative probability space 

As to sequences of qubits, the considerations made in the sectior^ may be thoroughly formalized, at the prize of 
assuming the coniectur dIV.ll as an hypothesis, through the following: 

Theorem IV. 1 

Weak- shallowness of random sequences of qubits: 
HP: 

Coniectur dIV.ll holds 

TH: 

RANDOM (E^q) n WEAKLY - DEEP{Y^ C ) = 
PROOF: 

Since the unbiased state T un uased is certainly U-computable and by definition: 

RANDOM(X% c ) = T unbiased - RANDOM(X% c ) 
the assumption of the coniectur dIV.ll as an hypothesis immediately leads to the thesis ■ 



(4.13) 



(4.14) 
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V. THE DEFINITION OF THE PHYSICAL COMPLEXITY OF QUANTUM DYNAMICAL SYSTEMS 

As we have seen in sectior lTTTl the Kolmogorov-Sinai entropy hxs{CDS) of a classical dynamical system CDS := 
(X , fj,, T) has a clear physical information-theoretic meaning that we can express in the following way: 

1. an experimenter is trying to obtain information about the dynamical evolution of CDS performing repeatedly 
on the system a given experiment exp € EXPERIMENTS, 

2. h(exp , CDS) is the asymptotic rate of acquisition of classical information about the dynamics of CDS that he 
acquires replicating exp 

3- hjis(CDS) is such an asymptotic rate, computed for the more informative possible experiment: 

h KS {CDS) = sup h(exp,CDS) (5.1) 

expeEXPERIMENTS 

Let us now pass to analyze quantum dynamical systems, for whose definition and properties I demand to |ll| . 

Given a quantum dynamical system QDS the physical information-theoretical way of proceeding would consist 
in analyzing the same experimental situation in which an experimenter is trying to obtain information about the 
dynamical evolution of QDS performing repeatedly on the system a given experiment exp G EXPERIMENTS: 

1. to define h{exp , QDS) as the asymptotic rate of acquisition of information about the dynamics of QDS that 
he acquires replicating the experiment exp 

2. to define the dynamical entropy of QDS as such an asymptotic rate, computed for the more informative possible 
experiment: 

resulting in the following: 

Definition V.l 

dynamical entropy of QDS: 

h d . e .{QDS) = sup h{exp,QDS) (5.2) 

expGEXPERIMENTS 

Definition V.2 

QDS is chaotic: 

h d . e .(QDS) > (5.3) 

The irreducibility of Quantum Information Theory to Classical Information Theory, caused by the fact that the- 
orerr lIII.3l doesn't extend to the quantum case owing to the existence of some non-accessible information about a 
quantum system (as implied by the Gronwald-Lindblad-Holevo Theorem) and the consequent irreducibility of the 
qubit to the cbit |42j| . [llj . would then naturally lead to the physical issue whether the information acquired by the 
experimenter is classical or quantum, i.e. if h^.eXQDS) is a number of cbits or a number of qubits. 

Such a physical approach to quantum dynamical entropy was performed first by Goran Lindblad 0] and later 
refined and extended by Robert Alicki and Mark Fannes resulting in the so called Alicki- Lindblad- Fannes entropy 

Many attempts to define a quantum analogue of the Kolmogorov-Sinai entropy pursued, instead, a different purely 
mathematical approach consisting in generalizing noncommutatively the mathematical machinery of partitions and 
coarsest-refinements underlying the definitior llll.lll obtaining mathematical objects whose (eventual) physical mean- 
ing was investigated subsequently. 

This was certainly the case as to the Connes-Narnhofer- Thirring entropy, the entropy of Sauvageot and Thouvenot 
and Voiculescu's approximation entropy |45j|. |46| . 

As to the Connes-Narnhofer- Thirring entropy, in particular, the noncommutative analogue playing the role of the 
classical partitions are the so called Abelian models whose (eventual) physical meaning is rather obscure since, as it 
has been lucidly shown by Fabio Benatti in his very beautiful book [43, they don't correspond to physical experiments 
performed on the system, since even a projective-measurement (i.e. a measurement corresponding to a Projection 
Valued Measure) cannot, in general, provide an abelian model, owing to the fact that its reduction-formula corresponds 
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to a decomposition of the state of the system if and only if the measured observable belongs to the centralizer of the 
state of the system. 

It may be worth observing, by the way, that the non-existence of an agreement into the scientific community as 
to the correct quantum analogue of the Kolmogorov- Sinai entropy and hence on the definition of quantum chaoticity 
shouldn't surprise, such an agreement lacking even for the well more basic notion of quantum erg odicity, Zelditch's 
quantum ergodicity |48| (more in the spirit of the original Von Neumann's quantum ergodicity |49j | to which it is not 
anyway clear if it reduces exactly as to quantum dynamical systems of the form (A, u> , a) with cardNc(A) < Ko and 
a G INN(A)) differing from Thirring's quantum ergodicity |50j | adopted both in |47| and in [44l |. 

Returning, now, to the physical approach based on the definitior lV.il the mentioned issue whether the dynamical 
entropy h^ e (QDS) is a measure of classical information or of quantum information (i.e. if it is a number of cbits or 
qubits) is of particular importance as soon as one tries to extend to the quantum domain Joseph Ford's algorithmic 
approach to Chaos Theory seen in sectior lTTTl 

1. in the former case, in fact, one should define quantum algorithmic chaoticity by the requirement that almost all 
the trajectories, symbolically codified in a suitable way, belong to BRU DNO(E°°) for quantum weak algorithmic 
chaoticity and to CHAITIN — RAN DOM {YP° ) for quantum strong algorithmic chaoticity 

2. in the latter case, instead, one should define quantum algorithmic chaoticity by the requirement that almost all 
the trajectories, symbolically codified in a suitable way, belong to RANDOM (£^ c ) 

In any case one would then be tempted to conjecture the existence of a Quantum Brudno's Theorem stating the 
equivalence of quantum chaoticity and quantum algorithmic chaoticity, at least in weak sense, for quantum ergodic 
dynamical systems. 

The mentioned issue whether the dynamical entropy hd. e .{QDS) is a measure of classical information or of quantum 
information (i.e. if it is a number of cbits or qubits) is of great importance also as to the definition of a deep quantum 
dynamical system (i.e. a physically- complex quantum dynamical system): 

1. in the former case, in fact, one should define a strongly (weakly) - deep quantum dynamical system as a quan- 
tum dynamical system such that almost all its trajectories, symbolically codified in a suitable way, belong to 
STRONGLY - DEEP(E°°)(WEAKLY - DEEP^ 00 )). 

2. in the latter case, instead, one should define a weakly-deep quantum dynamical system as a quantum dynamical 
system such that almost all its trajectories, symbolically codified in a suitable way, belong to WEAKLY — 
DEEP(Z% C ) 

In any case, or by the theorerr fll.3l or by the thcorcn TlV.il one would be almost certainly led to a quantum analogue 
of theorerr llII.8l stating that a chaotic quantum dynamical system is weakly- shallow, i.e. is not physically complex. 
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VII. NOTATION 



V 


tor every (universal quantiticator) 


V — /i — a.e. 


tor /i — almost every 


— i 
d 


exists (existential quantificator) 


d ! 


exists and is unique 


x = y 


x is equal to y 


x := y 


x is denned as y 


-np 


negation of p 


Zj 


omaiy aipnaoci -^u, ij 




n-letters' alphabet 




strings on the alphabet S„ 




sequences on the alphabet S„ 


X 


string 


\x\ 


length of the string x 


<l 


lexicographical ordering on E* 


string(n) 


n th string in lexicographic order 


X 


sequence 




concatenation operator 


x n 


n za digit of the string x or of the sequence x 


x(n) 


prcnx ot length n ot tnc string x or ot trie sequence x 


X* 


canonical string of the string x 


K(x) 


plain Kolmogorov complexity of the string x 


I(x) 


algorithmic information of the string x 


U(x) i 


U halts on input x 


D s (x) 


logical-depth of x at significance level s 


i — U Fj Hi r J 


i-ueep siimgs oi coils 


t - SHALLOW^*) 


t-shallow strings of cbits 


REC - MAP(N , N) 


(total) recursive functions over N 


<T 


Turing rcducibility 


<£ 


polynomial time Turing reducibility 


<tt 


truth-table reducibility 


CHAITIN - RANDOM^ 00 ) 


Martin L6f - Solovay - Chaitin random sequences of cbits 


HALTING^) 


halting set of the measure \x 



21 



II, T U 


Lcbcsguc measure 


fj, - RANDOM(T, x ) 


Martin L6f random sequences of cbits w.r.t. ji 


B(x) 


Brudno algorithmic entropy of the sequence x 


BRUDNO(T.°°) 


Brudno random sequences of cbits 


STRONGLY - £>&EP(E°°) 


strongly-deep sequences of cbits 


STRONGLY - S H ALLOW '(E°°) 


strongly-shallow sequences of cbits 


WEAKLY — DEEP(T,°°) 


wnflklv-Hppn ^priiiPTippQ of rbit^ 


WEAKLY — SHALLOW(E°°) 


weakly- shallow sequences of cbits 


V(X u) 


(finite, measurable) partitions of (AT , 


-< 


coarse- graining relation on partitions 


Ay b 


coarsest refinement of A and B 


h>CDS 


Kolmogorov- Sinai entropy of CDS 


ib a 


symbolic translator w.r.t. A 




k-point symbolic translator w.r.t. A 


V A 


orbit symbolic translator w.r.t. A 


rh 


change of basis from tl\ to 1x2 


Do 


Brudno algorithmic entropy of x's orbit in CDS 


H(P) 


Shannon entropy of the distribution P 




average code-word length w.r.t. the code D and the distribution P 


Lp 


minimal average code-word length w.r.t. the distribution P 


H2 


onc-qubit's Hilbert space 


nf" 


n-qubits' Hilbert space 




computational basis of 1~C^ n 




Hilbert space of qubits' strings 


£* 


6?) * 

computational basis of 




Hilbert space of qubits' sequences 


£00 


computational rigged-basis of 7i® 00 


B(W) 


bounded linear operators on Tt 



1 / -*- 

vl> > 


canonical program of \ip > 


D s {\4> >) 


logical depth of \ip > at significance level s 


t - DEEP(K® *) 


t-deep strings of qubits 


t - SH ALLOW (H® *) 


t-shallow strings of qubits 


S(A) 


states over the noncommutative space A 


card(A) 


cardinality of A 


INN(A) 


inner automorphisms of A 


card NC (A) 


noncommutative cardinality of A 


^unbiased 


unbiased noncommutative probability distribution 




noncommutative space of qubits' sequences 


R 


hypcrfinite II\ factor 


RAN DOM (£~c) 


random sequences of qubits 


—tt 


quantum truth-table reducibility 


WEAKLY - DEEP{T^ C ) 


weakly-deep sequences of qubits 


WEAKLY - SH ALLOW (Y^c) 


weakly-shallow sequences of qubits 


^■RANDOMNESS (A w ) 


laws of randomness of (A , u) 


w - RANDOM(Y,% c ) 


random sequences of qubits w.r.t. to 


hd.eXQDS) 


dynamical entropy of the quantum dynamical system QDS 


i.e. 


id est 


e.g. 


exempli gratia 
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